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DETAILED ACTION 



Claim Rejections - 35 USC § 101 

35 U.S.C. 101 reads as follows: 

Whoever invents or discovers any new and useful process, machine, manufacture, or composition of 
matter, or any new and useful improvement thereof, may obtain a patent therefor, subject to the 
conditions and requirements of this title. 

The USPTO "Interim Guidelines for Examination of Patent Applications for Patent 
Subject Matter Eligibility" (Official Gazette notice of 22 November 2005), Annex IV, 
reads as follows: 

Claims that recite nothing but the physical characteristics of a form of energy, such as a frequency, 
voltage, or the strength of a magnetic field, define energy or magnetism, per se, and as such are 
nonstatutory natural phenomena. O'Reilly, 56 U.S. (15 How.) at 112-14. Moreover, it does not appear 
that a claim reciting a signal encoded with functional descriptive material falls within any of the 
categories of patentable subject matter set forth in Sec. 101. 

... a signal does not fall within one of the four statutory classes of Sec. 101. 

... signal claims are ineligible for patent protection because they do not fall within any of the four 
statutory classes of Sec. 101. 



1. Claims 31 and 34 are rejected under 35 U.S.C. 101 because the claimed 
invention is directed to non-statutory subject matter as follows. Claims 31 and 34 define 
a computer data signal with descriptive material. While "functional descriptive material" 
may be claimed as a statutory product (i.e., a "manufacture") when embodied on a 
tangible computer readable medium, a data signal embodying that same functional 
descriptive material is neither a process nor a product (i.e., a tangible "thing") and 
therefore does not fall within one of the four statutory classes of § 101. Rather, "signal" 
is a form of energy, in the absence of any physical structure or tangible material. 



Claim Rejections - 35 USC § 101 
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35 U.S.C. 101 reads as follows: 

Whoever invents or discovers any new and useful process, machine, manufacture, or composition of 
matter, or any new and useful improvement thereof, may obtain a patent therefor, subject to the 
conditions and requirements of this title. 

The USPTO "Interim Guidelines for Examination of Patent Applications for Patent 
Subject Matter Eligibility" (Official Gazette notice of 22 November 2005), Annex IV, 
reads as follows: 

Descriptive material can be characterized as either "functional descriptive material" or "nonfunctional 
descriptive material." In this context, "functional descriptive material" consists of data structures and 
computer programs which impart functionality when employed as a computer component (The 
definition of "data structure" is "a physical or logical relationship among data elements, designed to 
support specific data manipulation functions." The New IEEE Standard Dictionary of Electrical and 
Electronics Terms 308 (5th ed. 1993).) "Nonfunctional descriptive material" includes but is not limited 
to music, literary works and a compilation or mere arrangement of data. 

When functional descriptive material is recorded on some computer-readable medium it becomes 
structurally and functionally interrelated to the medium and will be statutory in most cases since use of 
technology permits the function of the descriptive material to be realized. Compare In re Lowry, 32 
F.3d 1579, 1583-84, 32 USPQ2d 1031, 1035 (Fed. Cir. 1994) (claim to data structure stored on a 
computer readable medium that increases computer efficiency held statutory) and Warmerdam, 33 
F.3d at 1360-61, 31 USPQ2d at 1759 (claim to computer having a specific data structure stored in 
memory held statutory product-by-process claim) with Warmerdam, 33 F.3d at 1361, 31 USPQ2d at 
1760 (claim to a data structure per se held nonstatutory). 

In contrast, a claimed computer-readable medium encoded with a computer program is a computer 
element which defines structural and functional interrelationships between the computer program and 
the rest of the computer which permit the computer program's functionality to be realized, and is thus 
statutory. See Lowry, 32 F.3d at 1583-84, 32 USPQ2d at 1035. 



2. Claims 30 and 33 are rejected under 35 U.S.C. 101 because the claimed 
invention is directed to non-statutory subject matter as follows. Claim 30 and 33 defines 
a storage medium embodying functional descriptive material. However, the claim does 
not define a computer-readable medium or memory and is thus non-statutory for that 
reason (i.e., "When functional descriptive material is recorded on some computer- 
readable medium it becomes structurally and functionally interrelated to the medium 
and will be statutory in most cases since use of technology permits the function of the 
descriptive material to be realized" - Guidelines Annex IV). That is, the scope of the 
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presently claimed storage medium can range from paper on which the program is 
written, to a program simply contemplated and memorized by a person. The examiner 
suggests amending the claim to embody the program on "computer-readable medium" 
or equivalent in order to make the claim statutory. Any amendment to the claim should 
be commensurate with its corresponding disclosure. 



Claim Rejections - 35 USC § 102 

The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that 
form the basis for the rejections under this section made in this Office action: 
A person shall be entitled to a patent unless - 

(b) the invention was patented or described in a printed publication in this or a foreign country or in public 
use or on sale in this country, more than one year prior to the date of application for patent in the United 
States. 

Claim 1-4 and 30-32 are rejected under 35 U.S.C. 102(e) as being anticipated by 
Zickler et al. (referred to as "Zickler" herein. Article titled "Helmholtz Stereopsis: 
Exploiting Reciprocity for Surface Reconstruction") 

Regarding claim 1 , Zickler discloses a method of image reconstruction 
comprising: obtaining a Helmholtz reciprocal pair of images of an object aidd Helmholtz 
reciprocal pair of images comprising a first image and a corresponding reciprocal 
image; (see section 1 titled "introduction and section 4, subsection "Capturing 
Reciprocal Images." Here Zickler discloses capturing helmholtz reciprocal images). 
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determining a geometry associated with said obtaining of said Helmholtz 
reciprocal pair of images (see page 877-879, section titled "using the matching 
constraint as it discloses determining the surface geometry of the images. Specifically 
see the last paragraph on page 878.); 

selecting a plurality of points in said first image and identifying corresponding 
candidate points in said corresponding reciprocal image (see the second paragraph on 
page 878 as it discloses finding characteristics of a point Q and using the characteristics 
of the points to create a depth map); 

matching a selected point of said plurality of points and a candidate point of said 
corresponding candidate points (the system must match the points in order to create the 
depth map because the system needs both images to create the depth map. See 
pages 878-879 for more information). 

Regarding claim 2, Zickler discloses capturing a first image of said image pair 
with a first receiver at a first optical center and a first source at a second optical center; 
and capturing a second image of said image pair with at least one of said first receiver 
and a second receiver at said second optical center, and at least one of said first source 
and a second source at said first optical center (figures 1 , 5 and pages 876-877 
discloses using a light source and receiver that are placed on a wheel. Page 871 , 

paragraph starting with "Before describing Helmholtz stereopsis " Discloses that the 

light source is centered) 

Regarding claim 3, the rejection of claim 2 discloses all aspects of claim 3. 
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Regarding claim 4, please see the rejection of claim 4 and also page 878 as it 
discloses calculating the epipolar plane based on the helmholtz reciprocal images. 

Regarding claims 30-32, please see the rejection of claim 1 above. 
Claim Rejections - 35 USC § 103 

The following is a quotation of 35 U.S.C: 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

3. Claim 5 is rejected under 35 U.S.C. 103(a) as being unpatentable over Zickler in 

view of Gerig et al. (5446548, referred to as "Gerig" herein). 

Regarding claim 5, Zickler does not explicitly disclose the specifics of using 

epipolar lines. However he does disclose using epipolar planes and creating depth 

maps. 

Gerig discloses selecting an epipolar line in said first image and a corresponding 
epipolar line in said corresponding reciprocal image based on an epipolar geometry; 
selecting an adjacent pair of points on said epipolar line in said first image of said 
reciprocal pair of images; applying an ordering principle based on said adjacent pair of 
points; and selecting a candidate matching point on said corresponding epipolar line in 
said corresponding reciprocal image (see column 5 lines 19-43 as it discloses a 
hierarchical matching process by using epipolar lines). 

It would have been obvious at the time of the invention to one of ordinary skill in 
the art to combine in Zickler the specifics of epipolar lines as taught by Gerig. The 
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reason for the combination is because it makes for a more robust system that allows the 
system to match points from one image to another. Further, both inventions are from 
the same field of endeavor of finding geometric relationships between images. 

4. Claims 6-13 and 15 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Zickler in view of Tu et al. (Paper titled, "Surface Reconstruction via Helmholtz 
Reciprocity with a Single Image Pair. This paper has a publication date of June 2003 
and will be referred to as "Tu" herein). 

Regarding claim 6, please see the rejection of claim 1 and page 872 of Zickler as 
it discloses using depth, intensity and finding the normal. Please take special note of 
equation (1). 

Zickler does not explicitly discloses refining prediction error based on the above 
information. 

Tu discloses refining a prediction error (see abstract and page 1 , paragraph 
starting with "By swapping the positions..." , and figure 1 as it discloses predicting and 
refining the prediction error based on the intensity response. 

It would have been obvious at the time of the invention to one of ordinary skill in 
the art to include in Zickler a prediction and refinement method as taught by Tu. The 
reason for the combination is because it allows for a system that can more accurately 
reconstruct the data. Further, both invention deal with Helmholtz image reconstruction. 

Regarding claim 7, equation 1 of Zickler discloses the equation as claimed. Also, 
equation (3) of Tu discloses the equation as well. 
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Regarding claim 8, please see page 883, third paragraph, of Zickler as it disclose 
that the BRDF can be taken into account. 

Regarding claim 9, please see page 882 of Zickler as it discloses that no 
assumption about the BDRF. 

Regarding claim 10-11, please see section 3 of Tu as it discloses taking into 
account specularities and shadows and occlusions. 

Regarding claim 12, section 3.2 of Tu discloses using dynamic programming. 

Regarding claim 13, section 5 of Tu disclose using global nonlinear optimization. 

Regarding claim 15, please see section 3.3 of Tu as it discloses all aspects of 



5. Claims 14 is rejected under 35 U.S.C. 103(a) as being unpatentable over Zickler 
in view of Tu in further view of Saund (5835241). 

Regarding claim 14, neither Zickler nor Tu discloses using a parametric model. 

Saund discloses using a parametric model (see column lines 14-42). 

It would have been obvious at the time of the invention to one of ordinary skill in 
the art to include in Zickler and Tu a parametric model means as taught by Zickler. The 
reason for the combination is because it makes for a more robust system that can store 
data by using less memory. 



claim 15. 



Allowable Subject Matter 



6. 



Claims 16-29, and 35 are allowed. 



7. 



Claims 33-34 would be allowable if 101 issues are resolved. 
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Conclusion 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Hadi Akhavannik whose telephone number is 571-272- 
8622. The examiner can normally be reached on 10:30-7:00. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Joseph Mancuso can be reached on (571)272-7695. The fax phone 
number for the organization where this application or proceeding is assigned is 571- 
273-8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated Jxiformation 
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